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ABSTRACT 

The paper introduces a framework for the recoverability anal- 
ysis in compressive sensing for imaging applications such as 
CI cameras, rapid MRI and coded apertures. This is done 
using the fact that the Spherical Section Property (SSP) of a 
sensing matrix provides a lower bound for unique sparse re- 
covery condition. The lower bound is evaluated for different 
sampling paradigms adopted from the aforementioned imag- 
ing modalities. In particular, a platform is provided to analyze 
the well-posedness of sub-sampling patterns commonly used 
in practical scenarios. The effectiveness of the various de- 
signed patterns for sparse image recovery is studied through 
numerical experiments. 

Index Terms — Compressed Sensing (CS) imaging, 
Transfer function, sampling mask, Spherical Section Property 
(SSP), relaxed Semidefinite Programming (SDP). 

1. INTRODUCTION 

Recoverability in Compressed Sensing (CS), in other words 
the problem of how to effectively reconstruct a sparse sig- 
nal from its compressive measurements, remains an open re- 
search problem for both engineers and applied mathemati- 
cians (Bfil. The demand for such analysis is paramount in CS 
imaging modalities where there is a need to examine the ef- 
fectiveness of structured sensing architectures subject to hard- 
ware configuration constraints EH). Examples include, but 
not limited to, Compressed Imaging (CI) cameras |7|[8l, rapid 
Magnetic Resonance Imaging (MRI) for medical applications 
1 5 , 9] and coded apertures in optics ifTOl . 

To date, there are only a few limited studies examining the 
conditions needed for unique recovery of sparse signals in CS 
imaging modalities. These works extend the results obtained 
for one dimensional CS recoveries to Kronecker sampling 
structures l6l fTT] - [T3ll by utilizing mutual coherency and re- 
stricted isometry analysis of the sensing matrices (HQ31 • Un- 
fortunately, such analysis constitute an NP-hard problem and 
provides loose recovery bounds suitable only for specialized 
sensing modalities such as the Gaussian/Bernoulli matrices 
lElBl • Recent analysis results introduced in fT5l[T9ll provide 
a new insight for tracking the needed recovery bounds using 
relaxed Semidefinite Programming (SDP) methods. Follow- 
ing these developments, this paper studies the recoverability 



conditions for sparse signals in CS imaging modalities that 
are characterized in terms of a (given): 

• Sub-Sampling pattern: which defines the under- sampling 
process in the domain of its feasibility. For example, 
in tomography imaging, CS samples are taken via 
projection along the radial lines of beam-paths and is 
modelled in a 2-D Fourier mask Q. 

• Sensing modality: which defines the connection be- 
tween the acquisition and sampling domains, thus iden- 
tifying the sampling basis for CS recovery, e.g. Fourier 
basis in MRI [3- 

In this paper we address the recoverability of three dif- 
ferent CS imaging architectures i.e. CI cameras, rapid MRI 
and coded apertures. In particular, we study the effectiveness 
of different sensing modality for sampling with their pertinent 
sub- sampling pattern masks. The unique sparse recovery con- 
ditions of such modalities are analyzed by tracking the lower 
bound of Spherical Section Property (SSP) of the correspond- 
ing sensing matrices with Kronecker structures. This lower 
bound is calculated using a relaxed Semidefinite Program- 
ming (SDP) method in ifTTl . The bound provides a platform to 
compare the well-posedness of any designed CS architecture 
prior to its practical developments, which can be an expen- 
sive and time consuming task. Furthermore, we have tested 
the sparse recovery of the constructed sensing matrices for the 
aforementioned applications by means of t\ -minimization us- 
ing Basis Pursuit (BP) problem in [ 20] to validate the recovery 
bounds provided by the relaxed- SDP. 

2. GENERAL CS IMAGING PIPELINE 

Following the works done in IT UlC)ll2T1l22ll . the common 
framework for existing CS imaging applications can be gen- 
erally overviewed by the pipeline demosntrated in Figure 
Q] The rational behind such generalization is to modify the 
recoverability of the existing CS imaging applications under 
one unique analysis framework in order to study the impact 
of different sampling scenarios. In this pipeline, the signal 
(image) of interest X(s) is realized in a domain of a linear 
transfer function, i.e. X(s) * 0(s), which is defined based 
on the characteristics of the applied system. For instance, 
in MRI (9J, the image is observed in Fourier transform do- 
main (also known as k- space), where it holds the raw data 



representing the spin density distributions. Therefore, the cor- 
responding transfer function is defined by the Fourier kernels 
i.e. 0(s) = J^(s). 
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Fig. 1. CS pipline for image acquistion and reconstruction 

The maximum allowable sensory resolution is carried out 
by the mesh design of the Field-Of-View (FOV) in the appli- 
cation. For example, in CI camera the number of the 
grid sampling points in the image is defined by the number of 
the micro-mirror arrays deployed in the FOV. Such grids are 
modelled by s Gnd G W n x R n and provide an m-by-n discrete 
Hence, the full discrete sampled image is pro- 



and this system is known to be 



image 

videdby Y = (X*0)(s) 

fully determined for any mathematical purposes. In general, 
the acquired samples are discrete and they can considered to 
be defined by the following discretization, i.e. 
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where, Ai and A 2 are the spatial grid spacing for vertical 
and horizontal vertices, accordingly and X[i, j] is the discrete 
model of the original image space. 

In CS imaging application, a subset of discrete sam- 
ples are available for digitization i.e. s^ nd , where ft C 
{0, 1, . . . , m • n — 1} is a subset indices defined from the 
mesh design. Therefore, the compressed samples, practically, 

are given by Yq = (X * 0)(s) and mathematically is 

c Grid 

known to be underdetermined system EH [5). This is be- 
cause the number of the acquired samples are less than the 
total number of the available grid points i.e. \ft\ < m • n. 
Later on, the digitized values of the CS samples are car- 
ried out by an Analog-to-Digital (ADC) converter of the 
CS hardware and can be represented by Y = $J X<£ 2 , 
where, X and Y are the original and transferred images 
in digital format, respectively. Also, $i G W nxm and 
$2 G R nxn are the discrete basis dictionaries exemplified 
in Figure [5] for different sampling (feasibility) domain. The 
corresponding Kronecker tensor arraying can be driven by 
vec(Y) = <E> T • vec(X.) = (<£ 2 ® $i) T vec(X), where vec(-) 
denotes mode-1 vectors in one column (lexicographic order- 
ing l24ll . Now, we can subject the assumption of compressed 



sampling to the system of measurements by 

vec(Y n ) = *^ec(X), (2) 

where, &q are the subset of column bases of subjected 
to the compressed sampling indices ft. As mentioned, the 
measurement system in Q is underdetermined and, therefore, 
there are infinite possible solutions to fit this equation. Never- 
theless, the prior information from the original signal makes 
the decoding possible by means of sparse decomposition in a 
pre-defined basis domain i.e. X = \I/C\I/ T and by substitut- 
ing it in (0 yields 

vec(Y n ) = *£*vec(C), (3) 

where \l> = \I/ (g) ^ is the Kronecker representation of the 
sparse operator. We define the sensing matrix A = G 
]g>|n|xiv^ w h ere TV = m • n is the number of the image pixels. 

The sub- sampling pattern ft is usually dependent to the 
architecture of the CS hardware. We adopt four masks from 
literature and demonstrate in FigureQ]for CS imaging applica- 
tions: radial 0, random (7]-[9]]> density- varied (9), and down- 
sampling fTOll . Table \T\ lists three main applications, where 
such masks are used for under- sampling. 
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Fig. 2. Four sub-sampling 32 x 32 CS masks i.e. s 



Grid. 



(a) 



8 radial lined mask; (b) random (uniform distribution); (c) 
density- varied; (d) down- sampling by factor 4. 
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Fig. 3. Sampling bases <!>: (a) Fourier; (b) MURA pattern; (c) 
Walsh-Hadamard; (d) Bernoulli; (e) Gaussian 

Table 1. CS Imaging application charactristics 
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CS Mask Ref. 
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3. UNIQUE ENCODING BY SSP 

From previous section, the sensing matrix A is defined in Kro- 
necker format in ([3]), which maps sparse images C into the 
measurement domain Y^, i.e. A : R N ^ Rl^l. This map- 
ping should be one-to-one in order to guarantee the unique re- 
coverability of the original image from the sampled measure- 
ments 05]]. Seminal works are done in fTT1 - IT3 1 for sparse re- 
covery of the Kronecker matrices using the mutual coherency 



bounds. However, such bounds are very loose and limited 
to certain applications e.g. Gaussian matrices (H and do not 
apply to general cases. We take different approach to guar- 
antee the sparse recovery of the Kronecker samplings. First 
we identify the relation between Spark (U[T4) and SSP O 
to grantees one-to-one mapping and then provide tractable 
bound for any arbitrary sensing matrices. 

Let us define the class of /c-sparse signals with N coeffi- 
cients (TV-length vector) by = {c G R N : ||c|| < k}. 
The unique mapping of /c-sparse signal c under the projection 
of the sensing matrix y = Ac is guaranteed if the nullspace of 
the sensing matrix, i.e. Af(A) = {77 G R^ : Arj = 0}, con- 
tains vectors with more than 2/c-sparsity, i.e. ^2 2 k £ N(A) 
[2j. Furthermore, by the definition of the Spark in fT4ll . i.e. 



Spark(A) = min \\r)\\^ 

r)eAf(A) 



(4) 



the unique encoding is satisfied if 2k < Spark(A). The prob- 
lem in (|4]) is a combinatorial minimization and is NP-hard. 
Tractable bound is proposed by means of SDP relaxation for 
the Spark in fl8l . which is computationally inefficient for di- 
mensions greater than N > 30 i.e. at most for ~ 5 x 5 im- 
age pixels. To overcome this problem, the lower-bound of the 
Spark is found by the Spherical Section Property (SSP) to pro- 
vide computationally efficient methods for tracking unique re- 
covery bounds. The SSP is defined as follows Q, 



SSP(A) min 



Nil 
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(5) 



If SSP (A) > A, then A is a lower-bound and is known to be 
the distortion value of the nullspace Af(A). High distortion 
values of A refers to almost an Euclidean nullspace, which 
contain vectors r\ with high cardinalities. This implies that 
most sparse vectors lie on the range space of the sensing ma- 
trix rather than the nullspace. Therefore, higher the A is, bet- 
ter the sensing matrix A is constructed for CS recovery. 

The nullspace vector 77 G N(A) can be extended as fol- 
lows || 77 ||i = Y!j=i\m\ = Ejli%sign(7fc) and using the 
Cauchy-Shwartz inequality, it yields 
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Substituting © in Q, the lower bound for Spark is provided 
by SSP i.e. A 2 < SSP 2 (A) < Spark(A). Following the 
above analysis, the sufficient condition for unique sparse en- 
coding is carried out as follows. 

Proposition 3.1 A system of linear equation Ac = y has the 
unique sparse solution, iff 



1 A 2 SSP 2 (A) 
where, A G R^ xN , ceR N ,y G R^l and < N. 



(7) 



The bound in ^ defines the maximum allowable sparsity rate 
of the solution c to satisfy the unique sparse recovery, which 
can be at most N/2. Also, following the work in [11], the 
bound in © is extendable to Kronecker matrices, where A = 
A2 <S> A\ . So, the sufficient condition for the linear system in 
© to have the unique sparse solution is 

k < min {Ai/2} < min {SSP 2 (AO/2}, (8) 
ie{i,2} L ie{i,2} L 

where, A^ refers to the lower bound of the SSP(A^ ) for mode- 
i in 2D format. The lower bound A of the SSP can be quan- 
tized by the relaxed SDP problem, proposed in fTTlL to study 
the recovery performance of the compressed sensing matri- 
ces. Seminal works exist in [ 15 , 18 , 19 ] for equivalent relaxed- 
SDP problems, where they have either complex SDP structure 
or practically inefficient for higher dimension. The proposed 
relaxed- SDP in ifTTl is driven by augmenting the LP and SDP 
cones together with O (N 2 ) and G(N A ) complexities, respec- 
tively. Hence, the problem is large-scale and practically is ca- 
pable of tracking the lower bound of the sensing matrix A up 
to N ~ 2000 in ordinary desktop machines. 



4. EXPERIMENTAL EVALUATIONS 

Our goal is to validate the recoverability of the different CS 
sampling masks, demonstrated in figure [2 which can be ap- 
plied in different practical scenarios e.g. CI cameras, medi- 
cal imaging: MRI and tomography, and coded apertures. In 
particular, we evaluate the SSP (A) lower bound, i.e. A, for 
unique recovery in by the proposed relaxed SDP prob- 
lem in [17 ] for the aforementioned CS masks. For every con- 
structed sensing matrix A, we also examine the sparse recov- 
ery by means of £1 -minimization in |20| using Basis Pursuit 
(BP) problem in order to validate the aforementioned lower 
bound A. We define the size of the original image X G 
R 32x32 consisting of TV = 1024 mesh-grids. We evaluate the 
SDP and £\ -minimization problems on different sampling ra- 
tios \Q\/N = {0.1, 0.2, . . . , 0.6} for 10 randomly generated 
masks (except radial and down- sampling masks) and average 
the results. The results in Figure |4(a)||4(c)| demonstrate the 
normalized unique recovery bound in (|7]) i.e. A 2 /2 versus the 
sampling ratio. Also, results in Figure [4(d)l|4(f)| demonstrate 
the sparse recovery using the BP problem. 

4.1. CI Camera 

In Compressed Imaging (CI) camera setup, the goal is to re- 
construct the image from its compressed measurements via 
randomly projected lights into a single/multiple sensors EE). 
The image is observed by programmable Digital Micromirror 
Device (DMD) with variety of possible transfer functions for 
sampling e.g. random i.i.d Gaussian/Bernoulli and Walsh- 
Hadamard bases Q. We assume ^ = W Daubechies— 4 



wavelet transform with 1 level of sparse decomposition. Ran- 
dom CS mask for s Gnd " is taken from Figure |2(b)| for sam- 
pling. The lower bound A of the SSP for the sensing ma- 
trix A in © is evaluated and shown in Figure |4(a)| The re- 
sults of BP problem also shown in Figure |4(d)| The results 
from both relaxed-SDP and BP problems suggest that using 
Walsh-Hadamard bases for sampling is capable of recovering 
low sparsity rate of images (high cardinality) better than the 
other two bases: Gaussian/Bernoulli. The benefit of deploy- 
ing Walsh-Hadamard is we don't need to restore the basis ma- 
trix and this can be effectively computed for high-dimensional 
image reconstructions in CS decodings. 

4.2. Rapid MRI 

In magnetic resonance imaging (MRI) body organs are 
scanned for clinical applications by collecting the images 
in Fourier domain (aka k-space) and, therefore, the corre- 
sponding transfer function cj> is derived from the Fourier 
basis kernels (9j. Here, we consider $ = J 7 , which is 
32 x 32 discrete Fourier basis matrix, for this experiment we 
use the same wavelets for sparse decomposition in Section 
14.11 we examine three CS masks for under- sampling: radial 
(maximum of 22 lines), random and density- varied random 
masks exemplified in Figure [2] Different number of lines 
{2, 4, . . . , 22} are used for radial mask and the sampling ra- 
tio is defines by |0|/iV, where Q corresponds to the indices 
occupied by the radial lines in the mask. The results of ap- 
proximated lower bound A and BP problems are shown in 
Figure [4(b)| and [4(e)! respectively. Results show that random 
mask with i.i.d Bernoulli distribution is slightly performing 
better than radial and density- varied masks. While designing 
the sampling mask in MRI can be complicated, our results 
suggest to perform sampling using random masks which takes 
samples on the periphery of the k-space. 

4.3. Coded Aperture 

The idea is to recover a high-resolution image from the low- 
resolution version. Due to the aperture problem the regis- 
tered image is subjected to the law of diffraction in the cam- 
era. Such diffraction is modelled by a Point Spread Function 
(PSF), which is also know as the transfer function in optics 
and is modelled by a complicated coded mask e.g. MURA 
pattern in Figure |3(b)| The general framework for down- 
sampled (compressed) coded aperture frame is give by = 
D(X * PSF), where D is the down-sampling operator fol- 
lowed by the CS mask in Figure |2(d)||[T0ll . The mask pattern 
should be prime-integer side length and hence we consider 
m = n = 31 in our experiment. The objective of MURA pat- 
tern mask is to filter certain wavelength which is of interest in 
both astronomical and medical applications. The correspond- 
ing transfer function operator is defined by <1> = J r_1 CpsF^ r , 
where Cpsf is the MURA pattern. Results of the lower bound 
A are sketched in Figure [4(c)| and the BP in Figure [4ffl] The 



most sampling ratio from down-sampling is 25% and we can- 
not go beyond than this ratio. We, also examine additional 
CS masks in Figure [2(b)| for random sampling to compare the 
results with downsampling method. The benefit of deploying 
this mask is to reach to higher performances by taking more 
samples, however, taking random samples requires a design 
of hardware setup in practice. 
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Fig. 4. Lower bound A by relaxed-SDP (first row) and phase 
transition of sparse recovery using £i -minimization (second 
row) for: (a&d) CI camera; (b&e) MRI; (c&f) Coded aper- 
ture. 

5. CONCLUDING REMARKS 

We have studied the unique recovery conditions of three ex- 
isting CS imaging applications i.e. CI cameras, rapid MRI 
and coded apertures, by means of tracking the lower bound of 
the SSP of the sensing matrices using a relaxed-SDP and then 
validated through numerical experiments using Basis Pursuit 
(BP) problem for sparse image recovery. Walsh-Hadamard 
sampling, in CI camera, was capable of high order recover- 
ies. This basis can be efficiently implemented in practice for 
decoding, since, there is no need to buffer the basis matrix and 
can be deployed as vector-matrix calculation. In MRI applica- 
tion, the performance of three sub-sampling pattern masks are 
studied and their effectiveness are verified. We noticed ran- 
dom mask performs slightly better than two other patterns i.e 
density-varied and radial. In coded aperture, the higher gain 
of recovery was observed using a circulant matrix with PSF 
kernel. We suggest CS practitioners to consider this sampling 
architecture for further investigations in practical problems. 
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